T<- . |_ 

naval ho 

►<ONlT»,tY. C*L.fOK-. 



NPS-55HH74051 

NAVAL POSTGRADUATE SCHOOL 

Monterey, California 




HEURISTICS FOR GLOBAL OPTIMIZATION OF 
CONSTRAINED NONLINEAR PROGRAMS 

by 

James K. Hartman 
May 1974 



Approved for public release; distribution unlimited. 



S°S:NPS.55HH740ei 



ared for: 
ce of Naval 



Research, Arlington, Virginia 22217 



NAVAL POSTGRADUATE SCHOOL 
Monterey, California 



Rear Admiral Mason Freeman Jack 

Superintendent 

The work reported herein was supported by the Office of Naval 
Reproduction of all or part of this report is authorized. 

This report was prepared by: 



. Borsting 
Provost 

Research. 



UNCLASSIFIED 



SECURITY CLASSIFICATION OF THIS PAGE (Whmn Daf Entered) 



REPORT DOCUMENTATION PAGE 



READ INSTRUCTIONS 
BEFORE COMPLETING FORM 



1. REPORT NUMBER 

NPS-55HH74051 



2. GOVT ACCESSION NO 



3. RECIPIENT’S CATALOG NUMBER 



4. title (and Subtitle) 



Heuristics For Global Optimization of 
Geftstrer Non 1 inear Programs 



5. TYPE OF REPORT & PERIOD COVERED 

FINAL- Sept. 73- May 74 



6. PERFORMING ORG. REPORT NUMBER 



7. AUTHORfs; 

James K. Hartman 



8. contract OR GRANT NUMBERCs; 



9. performing organization name and address 

Naval Postgraduate School 

Monterey, California 93940 Code 55Hh 



10. PROGRAM ELEMEN T. PROJECT. TASK 
AREA A WORK UNIT NUMBERS 

61152N,BR000-01, 

BROOO-Ol-lO.PO-4-0001 



11. CONTROLLING OFFICE NAME AND ADDRESS 



12. report date 



Office of Naval Research, Arlington, Va. 



13. NUMBER OF PAGES 



21 



14. MONITORING AGENCY NAME A A D DR ESSf// d///©f©nr from Controlling OUice) 



15. SECURITY CLASS, (ot thie report) 

UNCLASSIFIED 



15a. DECLASSI FI CATION/ DOWN GRADING 
SCHEDULE 



16. distribution ST at Em EN T ('o/ fhis Raporrj 

Approved for public release; distribution unlimited. 



17. DISTRIBUTION STATEMENT (of the mbetract entered in Block 20, if di//eranf from Report) 



18. supplementary notes 



19. key words (Continue on reverse eide if neceeemry and identify by biock number) 



Optimization, Global Optimization, Nonlinear Programming, Search methods 
and Heuristics 



20. ABSTRACT (Continue on reverse aide i/ nacaaaaiy and Identify by block number) 



We consider the problem of finding the global solution to non-convex 
nonlinear programs which may have local solutions distinct from the 
global solution. Several heuristic methods are proposed. The advantage 
and disadvantages of heuristic methods as compared with algorithmic 
methods are discussed. 



DD 



AN 73 l4/3 



EDITION OF 1 NOV 65 IS OBSOLETE 
S/N 0102-014- 6601 1 



UNCLASSIFIED 



security CUASSIFICATION OF this page (Wt>tn Datm Kntartd) 



^LCURtTY classification OF THIS PAGErMTr^n Dmtm Entmrmd) 



SECURITY CLASSIFICATION OF THIS PAGE(TW»»n Dmtm Entmrmd) 



Def i n1 t1on : A solution x e ¥ is a local optimal solution for 
NLP if there exists a neighborhood N of x* such that f(x*) ^ f(x) 
for all X e F n N. 

If f, are all convex functions, then we call NLP a convex 
program, and the following properties liold: 

1. The feasible region F is a convex set. 

2. Any local optimal solution to NLP is also a global 
optimal solution. 

For general, possibly nonconvex f, g^ we can no longer guarantee 
tliese properties. In particular, 

1. The feasible region is not necessarily a convex set, in fact 
it is not even necessarily a connected set. 

2. There may exist local optimal solutions which are not global 

optimal . 

Most of the well known nonlinear optimization algorithms will terminate 
when a local solution has been found and are not able to determine whether 
or not this solution is also global. Algorithms for extending local opti- 
mizers to find global solutions have recently been developed (see [9] 
for a summary of several methods). They can conveniently be divided into 
two classes, heuristic methods and algorithmic methods. 

Algorithmic methods are guaranteed to converge to a global optimal 
solution (perhaps only as the limit of an infinite sequence of operations). 
Also, and perhaps more important, the computations are organized in such 
a way that when the global solution is found, the algorithm can eventually 
recognize that the solution is, in fact, global and will thus terminate. 
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The best examples of algorithmic methods are the various versions of the 
oranch and bound algorithm as developed by Falk ana Soland[2], Falk [3], 

Soland [11], and Beale & Tomlin [1]. 

Heuristic methods, on the other hand, can be characterized as 
techniques which are plausible approaches to global optimization, but for 
which no convergence proof is known. Many heuristics can guarantee 
aroitrarily high probabilities of attaining the global optimum (if sufficiently 
large numbers of computations are done), but the critical difference is that 
a heuristic can never proclaim with certainty that the global solution has 
been found. Some examples of heuristic methods are found in Hesse [7], 

Hartman [5,6] and Opacic [10]. 

Algorithmic methods concentrate on gathering the information needed 
to £T^ve that the best solution found is, in fact, global, while heuristic 
methods concentrate on rapidly attaining good solutions and perhaps some 
degree of confidence that the best solution found is a global optimal solu- 
tion. Particularly relevant to this last goal is the work by Liau, Hartley, 
and Sielken [8] in which statistical confidence regions for the global 
solution are developed. 

Algorithmic methods are known only for certain classes of problems. 

In particular the branch and bound methods mentioned above require that NLP 
be a separable program. Heuristics are, in general, not so restricted, 
although particular computational schemes may apply only to particular 
problem types. 

The primary advantage of algorithmic methods over heuristics lies 
in the positive guarantee of global optimality which algorithmic methods 
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can provide. The disadvantages are first, that algorithmic methods may 
be too slow to converge so that, in practice, the guarantee of global 
optimality is meaningless; and second, that special problem structures 



are required. The preferred method 
problem to be solved. There is not 
available at this time to formulate 



probably depends on the particular 
sufficient computational experience 
general rules of choice. 



II. COMPONENTS FOR HEURISTIC GLOBAL OPTIMIZERS 



In this section we discuss some basic building blocks which can be 
combined in various ways to develop heuristic global optimizers for solving 
the nonconvex [JLP problem. In particular, the following structural components 
will be considered. 

A) Search methods for finding constrained local solutions to 
NLP. 

B) Procedures for obtaining new starting points for repeated 
application of the local search methods. 

C) Procedures for moving away from one local solution in an 
attempt to find a better one. 

D) Procedures for early termination of local searches which 
appear to be converging to local solutions which are already 
known. 

Combination of these components to form heuristic global optimizers will be 
considered in section III. 

A. Local Optimizers . Methods for finding constrained local 
optimal solutions to nonlinear programs are well developed. In particular 
penalty function methods would seem particularly relevant to the purpose of 
nonconvex optimization since they do not depend upon any convexity properties 
of the constraint functions or feasible region. We distinguish two classes 
of methods; 

A1 . Interior penalty functions (also known as barrier 
functions) the best known example is the SUMT function [4]. 
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r > 0 




Interior methods require an initial feasible x. 



A2. Exterior penalty functions such as 



m 



2 



Q(x,r) = f(x) + r y [min(0, b.-g.(x))] 

i=l ^ ’ 



Exterior methods do not require initial feasible solutions. It should be noted 
however, that for nonconvex problems there is no guarantee that the exterior 
penalty function method will converge to a feasible solution, so we must be 
prepared to correct for this problem if it occurs. 



optimization is to repeatedly apply a local optimizer starting each local 
optimization from a different initial point. Comparisons of several proce- 
dures for effectively selecting starting points for unconstrained global 
optimization can be found in [5] and [6], and similar procedures are worthy 
of consideration for the constrained NLP. The constrained case is more 
difficult since if we wish to use an interior penalty method for the local 
optimizer, then the starting point must be in the interior of the feasible 
region F. Several possible methods are indicated below: 



St art i ng Poi nt s . Perhaps the oldest proposal for global 



B1 . Sample x from a uniform random distribution over the 



set 



S°=(x I L. j 



.. , n}. 



If also 



X e R® = (x I g^.(x) < b^; i =1, ... , m} 
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then use x as a new starting point for local optimization. Otherwise 
repeat the process, continuing to sample x e until x e is 
found. The probability of finding a feasible starting point at any trial 
is the ratio of the volume of n to the volume of which is 
generally not known. Note, however, that if the problem contains an 
equality constraint, then the volume of R^ is zero and this method is 
not appropriate. 

B^. Sample x c randomly. If also x c R^ then x 
is a new starting point. If x ^ R*^, let 



11 = I g^- (x) ^ b. , i = 1 , . .. , m} 

and 

12 = {i I g. (x) < b. , i = 1 , . . . , m} 

Then formulate the "feasibility finding problem" 

FFP min I g.(x) 
i e II ^ 

St. g. (x) ^ b. i e 12 

L. sx. j = 1, ... , n 

and use an interior penalty function method to solve it. If a violated 
constraint (in II) becomes satisfied during the solution process it is 
moved to 12 and the process continues until either a feasible starting 
point is found, or a minimum to FFP is found but is not in R^. In the 
latter case a new x e is sampled and the process repeats. This 
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feasibility finding problem is due to Fiacco & McCormick [4j. 

B3. If exterior penalty functions are to be used for NLP, 
then any x i is suitable as a starting point, but it would seem 
reasonaole to restrict the choice to a random selection of x e S. Un- 
fortunately, there is no guarantee that convergence to a feasible point 
will occur since the exterior penalty function may be unbounded over 
Since exterior penalty functions generally converge to a point which is 
slightly infeasible it may be difficult to decide when the pathological 
behavior is occurring. 

B4. A better use of exterior penalties might be in a 
mixed interior - exterior function. Select x c S*^ randomly. Let II 
and 12 be defined as above, and formulate the mixed interior - exterior 
penalty function problem: 



min f(x) 
xrEn 



I r^q'TxT ^ ^ [min(0,b.-g.{x)]^ + r I (q-'V + jT^L”) 

icI2^9iU; 1 1 j=l j ""j '-j 



Minimization of this penalty function will maintain feasibility for the 

constraints in 12 and the upper and lower bounds on x while attempting to 

J 

converge to feasibility for the violated constraints in II. 

B_5. Each of the above methods B1 - B4 selects random points 
X r S^ without regard to where previous random points were selected. In [5] 
a method is developed which keeps track of the previously selected starting 
points and the trajectories from these starting points to the local optimal 
solutions found during previous searches. The new x e can then be 
selected to avoid researching portions of S which have already been searched. 
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This modification could be applied to any of B1 - B4 as presented above. 
Evidence in [5] for the unconstrained problem indicates that this modification 
may significantly improve the efficiency of global search procedures. 

Details of the procedure can be found in [5]. 

C. Leav i ng a Lo cal Solu tion. Once a local solution has been found 
by the local search algorithm, we face the problem of how to continue the 
search to find another hopefully better local solution. One procedure is 
to select a new starting point as in B1 - B5 hoping that a local search 
from the new point will converge to a new local solution. 

A more systematic procedure is to move away from the local solution 
keeping track of the penalty function value. Initially this value will 
increase, (since we are leaving a local minimum). If it subsequently begins 
to decrease then the chances are good that we have moved into the "region 
of attraction" of a different local minimum. Starting the local optimiza- 
tion algorithm at this point should then lead to a new local optimal solu- 
tion to NLP. Two versions of this idea are: 

C2- Move away from the local solution along some feasible 
direction d (one which points into the feasible region F ). This 
involves potential difficulties if the boundary of F is reached before 
the penalty function value decreases. Perhaps a better idea is the following: 
C2 . Suppose P(x,r) is the penalty function (interior, 

exterior, or mixed) which has been minimized to find the current local 
★ 

solution X . Add a new constraint 



gyx) 



n ^ p 

I 

j=l ^ ^ 



b 



2 

0 
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to the NLP problem. This constraint defines a hypersphere of radius 
bp centered at x* whose interior now becomes infeasible, hence 
excluding tne local solution x . Let 

P*{x,r,OQ) = P(x,r) + r [min(0,gQ(x)-bQ)]^ 

oe the penalty function resulting from augmenting the original P(x,r) 
witn an exterior term for the new constraint. Let x*(bQ) be the solution 
to min P*(x,r,b„). Gradually increasing the radius b of the exclusion 

X ^ * 

constraint will tend to drive x (Dq) away from the local solution x . 
Continue to increase b^ until either, 

a) P(x*(bQ),r) increases and then eventually decreases. Then 
continue to minimize P(x,r) starting from this new point, or 

b) no feasible x (bg) can be found. Then procedure has 

failed. 

Hyperspheric exclusion constraints have been previously considered 
by others (notably Hesse [7]) as devices for excluding local solutions. 

In these cases, however, the exclusion constraints have been retained 
for tne subsequent local searches thus permanently excluding the local 
solution X* from feasibility in the subsequent searches. This 
necessitates searching for the smallest possible radius bg to avoid 
the chance of also inadvertently excluding the global solution from further 
consideration. For our purposes the exclusion constraints are only temporary 
devices for moving away from a local solution. The risk of subsequently 
revisiting this same local solution is deemed preferable to the risk of 
permanently excluding the global solution. 



10 - 



D. Termination of Local Searches. If procedures such as those 
referenced in B5 are used to keep track of previously found local 
minima and, perhaps, the search trajectories leading to them, then 
subsequent local searches can be terminated prior to convergence if 
they seem to be repeating work which has already been done. 

D1 . The simplest procedure is to maintain a record of 
the local minima found so far. If a subsequent search comes within a 
tolerance distance 6 of one of these solutions, then terminate that 
search. This procedure can save considerable effort even if 6 is 
quite small since the bulk of the work with most local searches seems 
to be expended obtaining convergence close to the solution rather 
than arriving in the vicinity of the solution. 

D2 . If also a record of past search trajectories is 
maintained, then we can terminate any subsequent search which comes 
closer than a tolerance c to one of these trajectories. This involves 
substantially more bookkeeping and testing than D1 , but computational 
experience for the unconstrained problem in [5] indicates that it can be 
a desirable procedure. 
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III. m OUTLINE FOR SOME HEURISTIC GLOBAL OPTIMIZATION METHODS . 

The components described in the previous section can be combined to 
form heuristic global optimization methods. One possible combination 
is indicated in the flow chart of figure 1. 

Specifying the procedure to be used in each block (e.g. , B1 , B2, B3, 
B4, or B5) will determine a specific optimization method which fits this 
general pattern. The best choice is probably problem dependent in a 
fashion which is not now understood. We hope to do further computational 
experiments in the future to improve' our ability to specify the particular 
global search heuristic which is most likely to be successful for a given 
problem. 
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